Copyright © 1976 American Telephone and Telegraph Company 

The Bell System Technical Journal 

Vol. 55, No. 3, March 1976 

Printed in U.S. A. 



Jointly Adaptive Equalization and Carrier 

Recovery in Two-Dimensional Digital 

Communication Systems 

By D. D. FALCONER 

(Manuscript received October 22, 1975) 

In this paper, we describe a novel receiver structure for two-dimensional- 
modulated, suppressed-carrier data signals. The receiver consists of a 
passband equalizer followed by a demodulator which compensates for 
frequency offset and phase jitter; the demodulator's phase angle is pro- 
vided by a data-directed, carrier recovery loop, which is shown by analysis 
and simulation to be capable of tracking relatively high frequency phase 
jitter. A derivation of the receiver parameters is presented, based on a 
gradient algorithm for jointly optimizing the equalizer tap coefficients 
and the carrier phase estimate, to minimize the output mean-squared 
error. System performance is related to carrier phase-tracking parameters 
by analysis. Computer simulations confirm the feasibility of the receiver 
structure. 

I. INTRODUCTION 

In recent years, a number of double-sideband suppressed-carrier 
linear-modulation techniques have seen increasing application to the 
efficient transmission of digital data over band-limited channels. Two- 
dimensional modulation may be an appropriate designation for these 
techniques, since they call for coding the transmitted data as two- 
dimensional data symbols and transmitting the two components by 
amplitude-modulating two quadrature carrier waves. 

Phase-shift keying (psk) and quadrature amplitude modulation 
(qam, sometimes termed qask), illustrated in Fig. 1, are familar ex- 
amples. Other two-dimensional modulation examples, characterized 
by their signal constellations (discrete sets of two-dimensional data 
symbols), have been extensively studied. 1-3 

This paper presents a unified treatment of adaptive equalization, 
carrier recovery, and demodulation for two-dimensional-modulated 
data communication systems. Most previous studies of qam and psk 
systems have treated these receiver functions separately. 4-8 Kobayashi 
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Fig. 1 — Examples of two-dimensional signal constellations, (a) 8-phase psk. (b) 
16-point qam. 

presented a unified receiver structure applicable to two-dimensional 
modulation, based on maximum-likelihood reception. 9 Chang studied 
a unified linear receiver structure for (one-dimensional) single-sideband 
modulation systems. 10 A novel feature of the receiver structure pre- 
sented in this paper is the placement of the carrier phase-tracking and 
demodulation functions together, after adaptive passband equaliza- 
tion. f In a more traditional receiver arrangement, 8-10 baseband 
equalization follows demodulation and precedes decision-directed 
phase estimation, thereby introducing a delay of many symbol in- 
tervals between these two functions. The decision-directed phase esti- 
mate is therefore a delayed version of the true channel phase shift 
affecting the signal that is entering the demodulator. This delay 
would lead to inaccurate demodulation of a signal perturbed by a time- 
varying phase shift (phase jitter) introduced by some channels. The 
receiver structure presented here avoids this source of inaccuracy by 
placing both the demodulation and phase estimation functions after 
the equalizer. 

In Section II we introduce complex notation for two-dimensional 
bandpass signals and for the effects of linear distortion, phase jitter, 
and frequency offset. Section III introduces the receiver structure 
and reviews the function of the passband equalizer. Section IV intro- 
duces a mean-squared-error criterion and proposes a gradient al- 
gorithm for arriving at a (nonunique) set of equalizer tap coefficients 
and a carrier phase estimate to minimize it. This ideal gradient al- 
gorithm is the motivation for a joint decision-directed equalizer up- 



* The receiver structure and an equivalent implementation of it are depicted in 
Figs. 2 and 3, respectively. 
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dating and demodulation phase-tracking algorithm. It is shown that 
the phase-tracking algorithm performs essentially the function of a 
first-order phase-locked loop operating in discrete time. A very simple 
linear analysis of the loop in Section V illustrates its phase-jitter track- 
ing capability. The receiver's capabilities are further confirmed by the 
results of simulations, reported in Section VI. 

II. BANDPASS SIGNALS AND PHASE JITTER 

We consider double-sideband, suppressed-carrier, two-dimensional- 
modulated data signals specified by 

8(f) = E a n g(t - nT) cos 2rj c t - L &»g(t - nT) sin 2»M (1) 

where f e is the carrier frequency, g(t) is a suitably chosen baseband 
pulse waveform, T is the duration of a symbol interval, and the pair 
(a„, & n ) represents a discrete-valued two-dimensional data symbol. 
For example, in a 16-point qam system, each a n and a n is chosen inde- 
pendently from the set {±1, ±3}. In a phase-modulation system 
(psk), a„ and & n have the form a n = cos \f/ n and a n = sin^„, the 
information being coded onto the phase \f/ n - These examples are dis- 
played in Fig. 1. 

It is convenient to deal only with the positive frequency content of 
passband spectra. The associated time functions are complex-valued. 
Thus s(t) = Re [_s(t) -\- jS(t)2, where s(t) is the Hilbert transform of 
s(t) and [s(0 +j£(0D possesses a Fourier transform consisting of 
twice the positive frequency part of the spectrum of s (t) : 

S (t) + jS(t) m £ A n g(t - nT) exp(j2Tf c t), (2) 

n 

where A„ = a n + ja„. The complex passband waveform g(t — nT) 
X exp(j2irfct) is said to be analytic if its spectrum is nonzero only for 
positive frequencies. In general, we shall represent real quantities by 
lower-case letters and complex ones by upper-case letters. 

When s(t) is passed through a noisy linear channel, the output is 
expressed as 

«'(0 - Re {Z A n C(t - nT) exp[i(27r/ e « + 9)2) + »(0, (3a) 

n 

where C(t) is a complex baseband equivalent impulse response of the 
combined transmitting filter and channel, 6 a phase shift that may be 
inserted by the channel, and n(t) a realization of additive noise. 

Some channels introduce a time-varying phase shift, expressed in 
general as 

d(t) = 6 + 2*-A* + iKO. 
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Here 6 represents a fixed phase shift, A a fixed frequency offset, and 
i//(t) a random or quasi-periodic waveform that is a manifestation of 
phase jitter. On voiceband telephone channels, the peak magnitude 
of the waveform $(t) is usually less than about 10 degrees, and its 
highest frequency spectral component is typically less than 10 percent 
of the data signal's bandwidth. 11 If the typical rate of variation were 
comparable to the symbol rate 1/T, a mathematical model for phase 
jitter would be critically dependent on the linear filter transfer func- 
tions preceding and following the location where the channel phase- 
modulates the data signal with the phase jitter. However, the assump- 
tion of small, relatively slow phase jitter permits us to sidestep this 
distinction and to model the phase-jitter-perturbed received signal 
conveniently as 

s'(t) s Re }L A n C(t - nT) exp[y(2x/«* + *„)]} + n(0 ; (3b) 

T 

i.e., On is interpreted as the channel phase shift affecting the trans- 
mission of the nth data symbol A n . 

III. RECEIVER STRUCTURE 

Figure 2 shows the two-dimensional receiver structure. The real- 
valued received waveform s'(t) first enters a phase splitter, consisting 
of parallel passband filters with impulse responses h(t) and h(t), where 
h(t) is the Hilbert transform of h (t) ; thus the complex impulse response 
defined by H{t) = h(t) + jh(t) is analytic. An appropriate choice for 
H(t) is a filter matched to the transmitted pulse, i.e., 

H(t) = g(-t) exp(j2Tf c t). (4) 

If the channel C(t) were known a priori, an optimal choice for H(t) 
would be a matched filter impulse response 

C(-Z)*exp(j2ir/c0. 

The optimality of the complex matched filter and sampler for two- 
dimensional modulation is brought out in the studies of Kobayashi, 9 
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Fig. 2 — Two-dimensional receiver. 
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Ungerboeck, 12 and Ericson and Johansson. 13 Sampling is carried out at 
the symbol rate l/T. We assume a fixed choice of sampling phase and 
will not be concerned with its optimization. The problem of deriving 
the optimum sampling phase has been treated previously. 14-16 

The pair of outputs at time nT from the sampler r„ and f„ can be 
expressed as a complex sample 

R n = r n + jf n , 
which is of the form 

Rn = £ A k X n - k expZJ(2irf e nT + 0*)] + N n , (5) 

k 

where X„ = X(nT) is a sample of the overall complex baseband 
equivalent impulse response and N„ is a complex sample of filtered 
noise. 

The passband linear equalizer 7 with, say, 2M -f- 1 complex tap co- 
efficients {C*„)- M produces complex passband output samples [Q n \ 
which are a linear combination of sampled inputs; i.e., 

Q n = q „ + jq n = £ ClRn-k. (6a) 

fc— M 

Note that the equalizer's implementation is described either by the 
above complex expression or by two expressions for the two real out- 
puts, viz., 

M 

Qn = L (CkTn-k + Ckfn-k) (6b) 

A;— m 

M 

Qn = L {Cktn-k — CkTn-k), (6c) 

k M 

where 

C' k = c k - jc k . 

Expression (6) can also be expressed in vector notation. Define 

C M \ 

I 1 (7a) 

(7b) 

\R n +M/ 

Then 

Q n = C*R„, (8) 

where * means complex conjugate transpose. 
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Ideally, the passband equalizer's sampled impulse response {C*} 
should be such as to yield an overall passband channel with no inter- 
symbol interference; i.e., 

ideal Q n ■ A n exp[i(27r/ c n7' + 6 n )J 

The information symbol A n is then recovered by demodulating Q„ 
to baseband and quantizing the result in accordance with the two- 
dimensional signal constellation. If the demodulator has a phase esti- 
mate d n , the complex demodulated output is given by 

Y n a y n + jy n = Q n exp[- j(2Tf c nT + n )] (9a) 

or 

y n = q„ cos (2irf c nT + 6„) + Qn sin {2irf c nT + 0„) (9b) 

y n = -q n sin (2irf c nT + d n ) + q n cos (2x/ c n7 1 + 0„). (9c) 
The ideal output at time nT is A n and the receiver error is denned by 

E n = Y n - A„. (10a) 

For the joint optimization of the equalizer tap coefficients and the 
demodulator phase, we adopt the following mean-squared-error cri- 
terion: minimize e„, where 

E n =<|^n| 2 > (10b) 



e, 



and the expectation, denoted by ( ), is over the data sequence and 
noise. 1 

The receiver structure shown in Fig. 2 is characterized by the follow- 
ing expression for the complex output sample before quantization. 
From (6a) and (9a), 

Y n =\ E ClRn-k] exp[- j (2irf c nT + *„)]. (11) 

L k=-M J 

An alternative equivalent receiver has a "baseband" structure. De- 
fine a new set of tap coefficients by 

C* t '=Clexp(-j2irfJcT) (12a) 

and a set of demodulated received samples by 

R' H = R n exv(-j2Tf c nT). (12b) 



f The "symmetric" mean-squared-error criterion (10b) was proposed by R. D. 
Gitlin and K. H. Mueller as an improvement to the "single-sided" criterion proposed 
in Ref. 7. 
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Then (11) can be re-expressed as 



Y n = \ f C:R'„- k ]exp(-je n ) 



(12c) 



The fully equivalent implementation expressed by (12c) is depicted 
in Fig. 3. Note that the received samples are demodulated to baseband 
using a free-running oscillator as in (12b) before equalization. However, 
a second stage of demodulation following baseband equalization 
remains, whose purpose is to remove the effects of channel phase varia- 
tion. Again, the delay of the equalizer does not come between this 
secondary demodulation and the derivation of the phase estimate 6„. 
The equivalence of the "passband" and "baseband" receiver imple- 
mentations of Figs. 2 and 3, respectively, gives the system designer 
some extra flexibility. 



IV. OPTIMIZATION OF EQUALIZER TAP COEFFICIENTS AND 
DEMODULATION PHASE 

To bring out the relationships governing the optimal tap vector C„ 
and demodulator phase 0„ (both of which may be functions of time), 
we assume that successive data symbols are uncorrelated ; i.e., 



(AiA m ) - all l,m 
(AiA* m ) = (\A\*)8i m , 



(13) 



where 8i m is the Kronecker delta function. Then for future reference 
we note, from expressions (5) and (7b), that cross correlation of the 
data symbols with sampled phase-splitter outputs results in 



(A* n R n ) = X„ explJ(2Tf c nT + 0„)]<|A| 2 >, 



where 



X = 



fX- M exp(-j2Tf c MTT 
v X lV exp(j2Tf c MT) i 



(14) 



(15) 
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Fig. 3 — Equivalent implementation. 
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is the complex impulse response vector of the combination of the 
transmitter pulse filter and the channel, truncated to 2M + 1 samples. 
The channel correlation matrix or A matrix is defined to be 

(RnRn) Q 6 N 

<l^l 2 > 

This is a Hermitian matrix (A* = A) whose l-mth element is 

A ln = £ X n XU m -i exp[i2T/ c (Z - m)T] + P i- m , (17) 

n 

where {pi- m } is the noise autocorrelation. Furthermore, it is positive 
semidefinite. (For any vector u, uMu = <|u*R„| 2 > ^ 0.) 

Using definitions (10), (11), (14), and (16), we can rewrite «„ in terms 
of A and X, which are fundamental characteristics of the channel. 

e„ = {C„ - A-Kexpt-JiL - 0„)]}* 

■A{C n - A-*Xexp£-j(6n - 6n)l\ + 1 - XM-X (18) 

Because the matrix A is positive semidefinite, e„ has the unique 
minimum 

e miD = 1 - X*A~*X, (19) 

which is achieved when C„ and 0„ satisfy 

C„ = C n opt (0„) = A~ l X expl-j(9n - n )J (20) 

Observe that the solution (20) is not unique ; there is an infinitude 
of combinations (C„, d„ - d„) that yield the minimum. However, for 
any specific choice of 6 n (including zero), there is a unique optimum 
choice of C„. Indeed, this is a manifestation of the "tap-rotation" 
property of the passband equalizer which was pointed out by Gitlin, 
Ho, and Mazo. 7 In particular, when there is no attempt to estimate 
n (0n = 0), then any amount of frequency offset A(0„ = 2wnAT) 
causes C„ 0P t to "rotate" with frequency A. However, a typical adaptive 
equalizer whose tap coefficients may not be permitted to change by 
more than about 1 percent from one symbol interval to the next will 
not be able simultaneously to equalize the channel effectively and to 
rotate 27rA radians per symbol interval even for moderate amounts of 
frequency offset. Similarly, the equalizer taps could not be expected 
to track typical phase jitter components accurately. 

The principal innovation reported in this paper is the joint operation 
of the adaptive equalizer and a separate phase-tracking loop which 
removes the major burden of tracking from the slowly adapting 
equalizer. Assuming this separate phase-angle-tracking algorithm is 
successful so that the phase error (0„ - d„) remains constant, we ob- 
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serve, by writing the mean-squared error using definitions (10) and 
(11) as 

1 



«n = 



(|A| 2 ) 



(|0„ - A n exylJ{2irf c nT + 0„)]| 2 >, (21) 



that, if the equalizer's reference signal for the purpose of adapting its 
tap coefficients is {A„ exp[j(2wf c nT + <?„)]}, the reference signal 
rotates in synchronism with the frequency-offset and phase-jittered 
carrier of the received signal, and hence the equalizer tap coefficients 
do not have to rotate if 8„ — d„ remains constant. 

If the gradients of e„ with respect to the real tap coefficient vectors 
c„ and c„ are denoted respectively by Vc n e„ and Vc n e„ and if we define 
the gradient with respect to C„ to be 

Vc„e n ■ Vc n e„ + jV^e*, 

then the gradient of the right-hand side of (18) can be written 

Vc n e„ = 2{AC n - Xexp[-i(0 n - 0„)]}. (22) 

Then it follows from expression (18) and from the fact that A is positive 
semidefinite that Vc n e„ = is a necessary and sufficient condition for 
€ n to attain its minimum value.* If the receiver knew XexpO'0„), 
defined by (15), and A, defined by (16), and could calculate this 
gradient during each symbol interval, then in the nth symbol interval 
it could use a gradient algorithm to update its estimate of C n as follows : 

C n+1 = C n - \ Vc„e n , (23) 

where the gradient is defined by (22). In this equation, C„ is the esti- 
mate of the correct tap coefficient vector in the nth symbol interval 
and /3/2 is a positive constant. For the moment, we defer consideration 
of a more realistic algorithm that does not require prior knowledge of 
A and X. 

Let us now consider the means for providing the estimated sequence 
{(?„}. In general, of course, the true phase jitter angle sequence {0„| 
is a random process. However, the reasonable assumption that it 
varies slowly with n leads us to treat 0„ as a quasi-static parameter 
that must be estimated in symbol interval n from present and past 
received data {R n } and reference information symbols {.An}. 

Accordingly, the receiver will incorporate an algorithm for updating 
its estimate d„, based on a gradient search technique. The derivative 



* We assume that matrix A is nonsingular. 
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of e n with respect to 0„ is, for a fixed value of C n , 

V? n 6„ = -21m {C:Xexp[-i(0„ - 0»)]}. 

The estimate 0„ is thus updated as 

- a 

d n +l = On — y ^Jn^t 



(24) 



(25) 



where a/2 is a constant. In general, a should be large relative to the 
equalizer's constant 0, to ensure that the estimate 6„ can closely track 
a varying angle 0„, thereby obviating the need for the passband 
equalizer taps to follow it closely. 

Suppose the angle 0„ is not time-varying (0„ = 0). Then the sta- 
tionary points of the gradient algorithms (23) and (25) are the solu- 
tions of the equations 

Vce„ = 



or 



and 



or 



AC = Xexp[-i(0-0)], 

Vf€n = 

Im{C*Xexp[-y(0-0)]} = 0. 



(26) 



(27) 



It is easy to show from the Hermitian property of A that, if (26) is 
true, then (27) is true. Furthermore, A is positive semidefinite and 
thus expression (18) for the mean-squared error shows that the infinite 
set of stationary points, defined by (26), are the only global minima. 
The following question immediately arises: Starting with fixed 
initial values, C and O and assuming n = for all n, do the gradient 
algorithms (23) and (25) jointly converge to a stationary point? Note 
that by defining 



,n -\eJ' 



p = 



! ° 



and 



Vz„e n = I -=i — I , 



we can combine (23) and (25) by writing 

Z n+1 = Z n - PVz*. 



(28) 



It is shown in Ref. 17 that, if j8 and a are chosen small enough, the 
sequence {Z n } converges in mean-square to a stationary point for 
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which V z e„ = 0. As pointed out previously, the stationary points all 
yield the global minimum of the mean-squared error and thus (28) 
converges to yield the minimum mean-squared error. The question of 
rate of convergence will be treated in a later paper. 

In a practical situation, the receiver does not know a priori the 
ensemble averages represented by the channel correlation matrix A 
and the truncated impulse response vector X. In this situation, the 
receiver can approximate the gradient search algorithm by utilizing 
the gradients with respect to C and 0„ of the actual unnormalized 
squared error 

\E n \* = |CX - A n expCi(2T/enr + 0„)]| 2 

instead of its mean. The A„ used in this calculation is initially an ideal 
reference known to the receiver, and during normal operation it is 
the receiver's output decision A n in the nth interval. Thus a decision- 
directed stochastic approximation algorithm corresponding to (23) 
and (25) is 

C n+1 = C„ - 71 4 Ti r |R n R:C n - A* n R n exp[-i(27r/cn7 1 + <?„)]} 

= C »-7TTTn R »( ( 2»-©> < 29 ) 

where Q n = A„ exy[j(2irf c nT + 0„)] is the "rotated" reference for 
the equalizer in the nth interval, using the receiver's decision A„, and 

0„+i = 0„ + t^t- {c;R n A:exp[-i(2T/ c nT + 0»)]} 

I A- n | 

= 6 * + TT L Ti Im (Q-®>, (30) 

l"« I 

which can also be written as n+ i = 6„ + a/|.A n | 2 Im { F n ^4n}. 

Expression (30) has a simple heuristic interpretation. Suppose the 
equalizer has successfully removed all intersymbol interference so that 
its output, neglecting noise, can be written 

Q„ ttA„ exp[y(2ir/ e wT + 0,,)]. 

Then we can write (30) as 

0„+i « 0„ - a sin(0 n - 0„). (31) 

Equation (31) describes a discrete-time, first-order, phase-locked 
loop. Because the tracking algorithm makes use of the receiver's 
decisions, it can be termed a decision-directed tracking loop or a 
decision feedback loop. 58 As expressed in (31), the demodulator phase 
0„ is corrected by an amount proportional to the sine of the angular 
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difference between the demodulated output Y n and the receiver's 
decision A„. The maximum bandwidth of the phase jitter that can 
be compensated for is a function of the constants a and /3. This will 
be explored in the next section and in a subsequent paper. 

The decision-directed phase-tracking principle is well-known for 
application in systems that do not require adaptive equalization. 56 
Its appropriateness is further confirmed by studies of maximum-like- 
lihood detection. 9 - 12 

Note that there is a phase ambiguity in the receiver's decisions 
inherent in suppressed-carrier systems with symmetric signal con- 
stellations, using decision-directed phase tracking. For example, the 
qam signal constellation of Fig. 1 is quadrantally symmetric, and there- 
fore constant 90-degree errors in the phase of the receiver's decisions 
{An) are undetectable. This source of ambiguity is customarily re- 
moved by differentially encoding the transmitted data onto the points 
of the signal constellation, so that phase differences between successive 
decisions { A „}, rather than absolute phase values, convey information. 

V. THE PHASE-TRACKING GAIN CONSTANT a: TRACKING 
BANDWIDTH CONSIDERATIONS 

As pointed out in Section IV, the phase-angle-tracking algorithm 
is, assuming perfect equalization, basically that of a first-order phase- 
lock loop with gain constant a. The actual system does not behave 
quite as simply as this, however, since the passband equalizer, even 
with a small gain constant /3, will also attempt to track the phase to 
some extent; i.e., the difference equations (29) and (30) are coupled. 
This coupling and its effect on performance will be explored in a later 
paper. In this section, we ignore this effect and also the effect of im- 
perfect equalization. Furthermore, in view of the difficulty in analyzing 
discrete-time phase-locked systems, we make the following linearizing 
approximation for the steady-state phase error: |0„ — n | « ir, so 
that sin (0 n - 0„) « 0„ - 0„. We can write (31) as the simple linear 
difference equation 

n+1 = (1 - a)0„ + ad n . (32) 

The case of sinusoidal phase jitter, 0„ ■ Re |V expO'conT 7 )], is of 
interest because the phase jitter observed on telephone channels 
often consists of one or more sinusoids with frequencies w/27r Hz, which 
are harmonics of various power line frequencies. The response n 
= Re [_J exp(jwnT)2 of the linearized phase-locked loop to n is 
easily found to be given by 

7 " '<*•> " ex P (i.r) a - i + a (33) 
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Now let us consider the effect of additive noise on the linearized 
phase-tracking algorithm. Assume the complex, equalized, demodulated 
output can be written 

Y n = A n exp[-i(<?„ - 0„)] + V n , (34) 

where V n = v n + jv n is a complex gaussian random variable with 
zero mean. Although in general successive noise samples at the equal- 
izer output will be correlated, we assume they are uncorrected to 
simplify the results. The effect of this simplification should be minor 
if the phase-tracking bandwidth is much smaller than the data band- 
width or if the frequency response of the channel and of the equalizer 
are both nearly flat. Thus if the signal-to-noise ratio is {\A\ 2 )/Nq, 
(v n v m ) = (v n v m ) = (N /2)S nm , and (v n v m ) = 0. Then eq. (31) for up- 
dating 8„ can be written, after using the linearizing approximation as 
in (32), 

6 n+1 = (1 - a)6 n + a0„ + almfj^V (35) 

The random variable w n = Im {V„/A n ) is not gaussian unless |.A„| 
is constant (pure phase modulation). However, assuming the in- 
formation symbols and noise are independent, the \w n ) are zero-mean 
and statistically independent with variance (N /2){\/\A | 2 ). 

By the superposition principle for linear systems, the error in the 
output of the phase-locked loop is given by 

6 n - d n = Re [JZFtfu) - 1] exp(jomT)} + v n , (36) 

where the sequence {?„} satisfies 

v„ + i = (1 — a)v„ + aw n , (37) 

and therefore has zero mean and steady-state variance 



£5 ( * = 55^3 (lh*) 



(38) 



The mean-squared error in the phase estimate is thus 

((0 n -0n) 2 ) = ^|FO-Co)-l| 2 +<^), 

which from (33) and (38) is 

i(A BV\- |J|2 4 sin' ("772) 

U*» Vn) ) 2 a 2 + 4(1 - a) sin 2 (uT/2) 



+ 5(f^j<TXp>- ™ 



The residual rms phase jitter, given by the square root of the above 
expression, is plotted as a function of the coefficient a for signal-to- 
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noise ratios <| A \ 2 )/N of 30 dB and 22 dB in Figs. 4a and 4b, respec- 
tively. In each case, a 16-point qam constellation is assumed. The 
higher the phase jitter frequency u relative to the symbol rate 1/T, 
the greater the residual rms jitter. The curves in Figs. 4a and 4b show 
the case of no jitter (in which case, the residual jitter results from 
noise entering the discrete time-phase-locked loop) and also the cases 
of 14-degree peak-to-peak jitter with uT/2ir = 1/48 and with coT/2ir 
= 1/20. The choice of bandwidth of the decision-directed phase-track- 
ing loop, determined by a, should be governed by the highest expected 
phase jitter frequency. If the spectrum of the phase jitter is known, a 
higher-order phase-locked loop may permit more effective phase 
tracking. 

For given values of rms residual phase jitter, the error probability 
can be approximated as in Ref. 1. For example, we find from Fig. 4b 
that the residual rms phase jitter is about 2.5 degrees in the 16-point 
qam systems, for a = 0.3, when the channel has a signal-to-noise ratio 
of 22 dB and 14 degrees peak-to-peak channel phase jitter with fre- 
quency 1/48 that of the symbol rate. From Fig. 11 of Ref. 1, we find 
that the resulting error probability is about 4 X 10~ 7 . The same system 




0.2 



0.4 



0.6 0.8 1.0 0.2 0.4 

PHASE TRACKING COEFFICIENTS* 



0.8 



Fig. 4 — (a) Residual rms phase jitter for a channel with 30-dB s/n and 14-degree 
peak-to-peak phase jitter, (b) Residual rms phase jitter for a channel with 22-dB s/n 
and 14-degree peak-to-peak phase jitter. 
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with the same value of a in the absence of phase jitter has an error 
probability of about 5 X 10 -8 . The same system with a = and no 
phase jitter has an error probability of about 10 -8 . 

VI. SIMULATION OF THE QAM RECEIVER 

The receiver described in this paper with the qam constellation of 
Fig. 1 has been simulated on an IBM 370 computer, with 9600-b/s 
qam data signals transmitted over real voiceband telephone channels 
as input. The simulation technique and the evaluation of this and 
other high-speed modems were reported in Ref. 18. In general, over a 
variety of different voiceband channels, the qam system's performance 
appeared to be superior to that of all other systems tested. 

One channel used for transmission of the qam signals consisted of a 
Holmdel-to-Murray-Hill voiceband channel plus 50-Hz, 17-degree, 
peak-to-peak sinusoidal phase jitter which was inserted by a line 




Fig. 5a — Receiver output constellation a = 0.01. 
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Fig. 5b — Receiver output constellation a = 0.3. 

simulator. The phase jitter and other impairments contributed by the 
Holmdel-to-Murray-Hill line alone were not too severe; the worst 
impairment was second-harmonic distortion, amounting to 32 dB 
(fundamental to average second-order product). 

An illustration of the receiver's effectiveness in tracking and remov- 
ing sinusoidal jitter from the same recorded data signal is shown in 
Figs. 5a and 5b, in which the unquantized complex (i.e., two-dimen- 
sional) receiver outputs are plotted, y n versus y n , A ■ indicates that 
the particular set (y, y) occurred at least once during transmission, a 
+ that it occurred between 4 and 10 times, a # that it occurred between 
11 and 20 times, and an @ that it occurred more than 20 times. Thus, 
these figures are "constellations" or coarsely-quantized two-dimen- 
sional histograms of the receiver's demodulated ouput. The coordinates 
of the possible transmitted information symbols (±1, ±3 for qam 
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signals) are shown as circles. Figure 5a shows the two-dimensional 
receiver output constellation for the case when the parameter a is 
too small to allow the jitter to be tracked; a = 0.01. Thus, in this 
case, the original 17-degree peak-to-peak jitter appeared at the 
receiver output, resulting in the banana-like shapes lying along the 
circumferences of circles centered at the origin. Note that, if the only 
impairment present was additive random noise, we would expect 
the scatter plots to look like circles centered on the information symbol 
coordinates and with radii proportional to the rms value of the noise. 
Figure 5b is a constellation for the case a = 0.3, which allows the 
sinusoidal jitter to be tracked and almost completely removed by the 
demodulator. 

VII. SUMMARY AND CONCLUSIONS 

We have proposed a decision-directed demodulator phase-recovery 
loop coupled with adaptive passband equalization for use in a two- 
dimensional, suppressed-carrier, data communications system. Accu- 
rate compensation of phase jitter and frequency offset is afforded 
by placing the demodulator and a sufficiently wide bandwidth decision- 
directed phase-tracking loop together following the equalizer. 

The derivation of the receiver's adaptive algorithm for jointly setting 
the equalizer tap coefficients and the carrier phase estimate was based 
on a gradient search algorithm for minimizing an expression for the 
receiver's output mean-squared error. This gradient search algorithm 
was shown to converge in the absence of noise and phase jitter to a 
nonunique but optimal set of tap coefficients and carrier phase-angle 
estimate. 

Computer simulations using real-channel received waveforms re- 
ported here and in Ref. 18 confirm the feasibility of the qam receiver 
structure. 

Assuming perfect passband equalization and making a simplifying 
linear approximation, we analyzed the system's residual phase error 
as a function of carrier tracking loop gain, signal-to-noise ratio, and 
the amount and frequency of sinusoidal phase jitter. The optimum 
value of the carrier-tracking-loop-gain parameter a was seen to depend 
on the noise and phase-jitter parameters, although reasonable design 
compromises can be made. 

A forthcoming paper 19 will explore the adaptation and tracking 
behavior of the combined equalizer, carrier recovery system, and 
demodulator in more detail. 

The two-dimensional adaptive receiver structure described here can 
also be extended to systems employing decision feedback equalization. 
The performance of such a receiver will be reported in a later paper. 
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